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Abstract. An extractor is a function that receives some randomness 
and either "improves" it or produces "new" randomness. There are sta- 
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jrt , tistical and algorithmical specifications of this notion. We study an al- 

gorithmical one called Kolmogorov extractors and modify it to resource- 
bounded version of Kolmogorov complexity. Following Zimand we prove 
\ jr} \ the existence of such objects with certain parameters. The utilized tech- 

nique is "naive" derandomization: we replace random constructions em- 
ployed by Zimand by pseudo-random ones obtained by Nisan-Wigderson 
generator. 



1 Introduction 



An extractor is a deterministic procedure that extracts randomness from weak 
random sources. Concerning finite strings there are two concepts of specifying 
^. ' this notion: statistical and algorithmical. The statistical one considers proba- 

■^j- . bility distributions on inputs and outputs of such procedure in terms of min- 

C^^ ' entropy. Loosely speaking, to extract randomness means to produce a distribu- 

tion with higher min-entropy than any input has. This notion was invented by 
Nisan and Zuckerman in early 90s and was deeply examined by many researchers 
C*~) . through the last two decades. An introduction to the field is presented by Shaltiel 

in 0. 

An algorithmic counterpart, i.e. the notion of Kolmogorov extractors, was 

invented in the last several years (see [2], [3] and [II])- Roughly speaking, a 

Kolmogorov extractor is a function that receives two strings with sufficiently 

large Kolmogorov complexity and sufficiently small dependency and outputs a 

Vh ■ sufficiently long string having complexity closer to its length than any input 

has. It was shown in [3] that there exists a deep connection between ordinary 
and Kolmogorov extractors. Namely, each ordinary extractor is a Kolmogorov 
extractor with a bit worse parameters and vice versa. As shown in |10j and [11] , 
there also exist strong Kolmogorov extractors in a sense that the output is rather 
complex even being conditioned on any single input. 

The notion of Kolmogorov extractors may be naturally expanded to space- 
bounded complexity, it was done already in the original paper 2\ . The existence 
results of that paper hold both for common and space-bounded Kolmogorov ex- 
tractors. For the unbounded case these resuts were improved by Zimand in |10) 
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and |llj . In this paper we convert Zimand's results to the space-bounded case 
and hence improve the respective results of Fortnow et al. Since Zimand's con- 
struction is not efficient, this conversion cannot be done straightforwardly. The 
technique we employ is the "naive derandomization" method introduced in [5] 
and [4] and later used in [13] and [14]. Originally, Zimand have characterized 
Kolmogorov extractors by some combinatorial properties. The existence of an 
object with such properties was proven implicitly. We show that such an object 
may be found in the output of Nisan-Wigderson pseudo-random generator. That 
is, to find a required object one does not need to search through all possible ob- 
jects but needs only to check all seeds of the generator. This crucially decreases 
the required space from exponential to polynomial. 

The rest of the paper is organized as follows. In Sect. [2] we give formal def- 
initions of all involved objects and formulate necessary results. In Sect. [3] we 
give formal definitions for space-bounded Kolmogorov extractors, formulate our 
existence theorems, outline the proof idea and present detailed proofs. 

2 Preliminaries 

2.1 Kolmogorov complexity 

Let V be a two-argument Turing machine. We refer to the first argument as 
to the "program" and to the second argument as to the "argument". (Plain) 
Kolmogorov complexity of a string x conditioned on y with respect to V is the 
length of a minimal V-program p that transforms y to x, i.e. 

Cv(% I y) = min{p: V(p, y) = x} 

There exists an optimal machine U that gives the smallest complexity up to an 
additive term. Specifically, W3cVa;, y Cu(x\y) < Cv{x\y) + c. We employ such 
a machine Lt, drop the subscript and formulate all theorems up to a constant 
additive term. The unconditional complexity C{x) is the complexity with empty 
condition C(x | e), or the length of a shortest program producing x. 

The next notion to be defined is resource-bounded Kolmogorov complexity. 
Loosely speaking, it is the length of a minimal program that transforms y to 
x efficiently. Formally, Kolmogorov complexity of a string x conditioned on y 
in time t and space s with respect to V is the length of a shortest program 
p such that V(p, y) outputs x, works in t steps and uses s cells of memory. 
This complexity is denoted by C^f(x \ y). Here the choice of V alters not only 
complexity, but also time and space bounds. Specifically, the following theorem 
holds: 

Theorem 1. There exist a machinelA such that for any machine V there exists a 
constant c such that for all x, y, s and t it is true that C^ {x \ y) < Cy ,c ° s (x \ 
y) + c. 

In our paper we deal only with space bounds, so we drop the time-bound super- 
script in all notations. 



2.2 Extractors 

A fc-weak random source of length n is a random variable distributed on {0,1}™ 
that has min-entropy not less than fc, that is, any particular string occurs with 
probability not greater than 2~ k . The statistical distance between two random- 
ness distributions £ and r\ on the same set T is maxscT \£(S) — r](S)\. 

Loosely speaking, a randomness extractor is a procedure that converts weak 
random sources to nearly uniform random sources. There are two common spec- 
ifications of this notion: seeded extractor that gets a weak random source and 
a (small) truly random source and multi-source extractor that gets two weak 
random sources. The latter one is relevant to our paper, so we define it for- 
mally. A multi-source extractor with parameters (n, m, fc, e) is a function 
Ext: {0,1}™ x {0,1}™ -» {0,1}™* such that for any two independent fc-weak 
random sources x and y the induced distribution Ext(x, y) is £-close to uniform. 
A multi-source extractor may be considered as a 2" x 2™ table with each cell 
coloured in one of 2 m colours. It may be proven that the extractor property is 
equivalent to the following: for any set of colours ("palette") A C {0, l}™ 1 in any 
rectangle S\X S2, where Si C {0, 1}™ and \Si\ > 2 k the fraction of cells coloured 
in a colour from A differs from \A\/2 m by at most e. Yet another equivalent 
definition is the following: for any Q £ [1, 2 m ] and any Si x 52 the fraction of 
cells coloured in Q most popular colours does not exceed Q/2 m + e. 

2.3 Balanced tables 

A balanced table is a combinatorial object considered by Zimand in papers [9], [TO] 
and 111.. In the last paper he has also introduced a slightly different object called 
rainbow balanced table. In some sense they are similar to multi-source extractors 
but use another notion of closeness of distributions. Here we present alternative 
definitions that seem more comprehensive though equivalent to original ones. 

A ( J fC,Q)-balanced table is a function BT: {0, 1}™ x {0, 1}™ -» {0, l} m with 
the following property: in any rectangle Si x S2, where Si C {0, 1}™ and \Si\ > K 
the fraction of cells coloured in Q most popular colours is less than 2Q/2 m . 
Contrasting to multi-source extractors, this property is less restrictive for big 
palettes (\A\ > e2 m ) and more restrictive for small ones (\A\ < e2 m ). 

In QT] Zimand introduces a variation of the above-defined object named rain- 
bow balanced table. Here we present a bit different though equivalent definition 
of it. A (K,Q)-rainbow balanced table is a function RBT: {0, 1}™ x {0, 1}" -> 
{0, l} m with the following property. Consider a rectangle Si x S2 where Si C 
{0, 1}™ and \Si\ > K. Let us mark in each row all cells coloured in one of Q most 
popular colours of this row. Call the table row-rainbow-balanced if the fraction 
of marked cells in any rectangle is less than 2Q/2 m . Then do the same with 
columns and call the table column-rainbow-balaced if the fraction of marked 
cells is again less than 2Q/2 m . Finally, call the table rainbow-balanced if it is 
both row- and column-rainbow-balaced. 

It was shown by the probabilistic argument that there exist balanced tables 
with K > VMpoly(n) and Q > \ZMpo\y(n) and rainbow balanced tables with 
K > M poly(n) and any Q. 



2.4 Nisan-Wigderson generators 

The Nisan-Wigderson pseudo-random generator is a deterministic polynomal- 
time function that generates n pseudo-random bits from polylog(n) truly random 
bits. The output of such generator cannot be distinguished from truly random 
string by small circuits. Specifically, we exploit the following theorem from [5]: 

Theorem 2. For any constant d there exists a family of functions G n : {0, 1} — > 
{0, 1}™, where k — 0(log n), such that two properties hold: 

Computability: G is computable in workspace poly(/c) (that is, any particular 

bit of G(x) may be found in this space); 
Indistinguishability: For any family of circuits C n of size poly(n) and depth 

d for any positive polynomial p for all large enough n it holds that: 

\Prob x {C n (G n (x)) = 1} - Prob y {C n (y) = 1}| < -L-, 

p{n) 

where x is distributed uniformly in {0, l} k and y — in {0, 1}™. 

By rescaling parameters we get the following 

Corollary 1. For any constant d there exists a family of functions G n : {0, l} fe — > 
{0, 1} N , where k = poly(n) and N — 2 poly( - n > , such that two properties hold: 

— G is computable in polynomial workspace; 

— For any family of circuits C n of size 2 poly ( n ) and depth d, for any constant 
c and for all large enough n it holds that: 

\Prob x {C n (G n (x)) = 1} - Prob,{C„(y) = 1}| < 2" cn . 

The last corollary implies the following basic principle: 

Lemma 1. LetC n be some set of combinatorial objects encoded by boolean strings 
of length 2 ^ n ' . Let V be some property satisfied for fraction at least a of objects 
in C n that can be tested by a family of circuits of size 2 ( n > and constant depth. 
Then for sufficiently large n the property V is satisfied for fraction at least a/2 
of values of G n , where G n is the function from the previous corollary. 

2.5 Constant-depth circuits for approximate counting 

It is well-known that constant-depth circuits cannot compute the majority func- 
tion. All the more they cannot compute a general threshold function that equals 
1 if and only if the fraction of l's in its input exceeds some threshold a. Neverthe- 
less, one can build such circuits that compute threshold functions approximately. 
Namely, the following theorem holds: 

Theorem 3 ([lj, [8]). Let a S (0,1). Then for any (constant) e there exists a 
constant- depth and polynomial- size circuit C such that C(x) = if the fraction 
of l's in x is less than a — £ and C(x) = 1 if the fraction of l's in x is greater 
than a + e. 

Note that nothing is promised if the fraction of l's is between a — e and a + e. 
So, the fact that C(s) = guarantees only that the fraction of l's is at most 
a + e, and C(s) = 1 — that it is at least a — e. 



3 Main result 

3.1 Overview 

In this section we give all necessary definitions, observe existing results and 
formulate our theorem. 

Let us formally define a Kolmogorov extractor. Dependency between x and 
y is defined as dep(x,y) = C(x) + C(y) — C(x,y). A computable function 
KExt: {0, 1}™ x {0, 1}™ — > {0, l} m is a (fc, 6)-Kolmogorov extractor if for any x 
and y of length n if C(x) > k, C(y) > k and dep(x, y) < 6 then C(KExt(x, y)) > 
m — 5 — 0(log n) . Say that KExt is a strong (k, <5)-Kolmogorov extractor if, more- 
over, C(KExt(a;, y)\x) > m— S— O(logn) andC(KExt(x, y)\y) > m-5—0(logn). 

Zimand has proven that there exist Kolmogorov extractors with parameters 
close to optimal: 

Theorem 4 ([10j , [llj). Let k(n) and 5{n) be computable functions, such that 
1 < k(n) < n and 1 < 5(n) < k(n) — O(logn). Then there exists a (k(n), S(n))- 
Kolmogorov extractor for m = 2k(n) — 0(logn) and a strong (k{n), 5(n))- 
Kolmogorov extractor for m = k(n) — O(logn). 

We rewrite the definitions and the theorem in the case of space-bounded 
complexity. Since the difference C s (x) — C s (x\y) is not monotone in s, we get rid 
of explicit usage of the term "dependency" . Instead we say that a computable 
function KExt is a (k, <5)-Kolmogorov extractor with a space bound s = s(n) 
if KExt is computable in space 0(s(n)) and for some constant /i > 1 (not 
dependent on x, y, k, s, but possibly dependent on KExt) if C s (x) > k, C s (y) > 
k, andC^y) > C s (a;) + G s (y) - S then C s (KExt(a;, 2 ;)) > m - 6 - O(logn). 
If, moreover, C s (KExt(x , y)\x) > m - 5 - O(logn) and C s (KExt(cc,y)|y) > 
m — 8 — O(logn) then the Kolmogorov extractor is strongly We increase the 
space limit from s to ^s in the definition of "dependency" since the space limit is 
determined up to a multiplicative constant dependent on the description method. 
We prove the following: 

Theorem 5. There exists a polynomial p(n) such that for any space- constructible 
function s(n) > p(n) and any computable in space s(n) functions 1 < k(n) < n 
and 1 < S(n) < k(n) — 0(logn) there exists a (k(n), 5(n))-Kolmogorov extractor 
with space bound s(n) for m — 2k(n) — O(logn) and a strong (k(n), 8{n))- 
Kolmogorov extractor for m = k(n) — O(logn). 

3.2 Proof idea 

In this section we retell Zimand's argument in space-bounded environment and 
emphasize what must be added to complete the proof. 

We show that a certain balanced table is in fact a Kolmogorov extractor. 
The main idea is to obtain a contradiction between the hardness of (x, y) and 



1 Fortnow et al. do use the term "dependency" in [2] but define it for two distinct 
space bounds that correspond to s and fis in our definition. 



the simplicity of T(x, y) by employing the balancing property. Let us come to 
more details. Let d = 5 + clogn, where c is a constant to be determined later. 
Take a (2 fc , 2" l - d )-balanced table T: {0,1}™ x {0,1}™ -> {0, l} m . Let B x = 
{z | C s {z) < C s (x)}, B y = {z \ C s (z) < C s (y)} and A = {u; | C s (i/;) < 
m — d}. Obviously, (x, y) E B x x B y . By the balancing property, the set -B x x B y 
contains less than 2 • 2 C * ^( :E )+ 1 2 C£ 'W+ 1 /2 d cells coloured in a colour from A, 
that is, in a colour with complexity less than m — d. (If necessary, expand B x , 
By and A arbitrarily to obtain sets of required size and apply the balancing 
property). Hence, (x,y) may be described by the table T, the sets B x , B y and 
A, and the ordinal number of (x, y) among cells in B x x B y coloured in a colour 
from A. By the balancing property the last number requires at most C s (x) + 
C s (y) — d + 3 bits. The sets B x , B y and A are described completely by n, 
C s (x) and C s (y) and may be enumerated in space O(s). If we obtain a table 
T that has complexity O(logn) and may be evaluated in space O(s) then we 
have C°( s '(x,y) < C s (x) + C s (y) — d + 0(\ogn) that contradicts the assumption 
C fJ,s (x,y) > C s (x) + C s (y) — S for fj, and c large enough. So, the crucial missing 
component is a simple and space-efficiently computable balanced table. Without 
a space bound the existence of such table is proven by the probabilistic method 
and a simple table may be found by an exhaustive search: the first table in 
some canonical order has small complexity. Having a space bound added the 
construction should be derandomized. 

To get the strong Kolmogorov extractor property we need to replace a bal- 
anced table by a rainbow balanced one with parameters (2 k ,Q — 2 m ~ d ) where 
again d = 5 + clogn. Let A v be the set {w | C s (w\v) < m — d}. Obviously, 
\A V \ < Q. Call a string v bad if the fraction of cells in the row B x x {v} coloured 
in a colour from A v is greater than 2 x 2~ d . The fraction of cells coloured in 
one of Q most popular colours is even greater, so there are less than K bad 
rows, since otherwise the colouring of the rectangle B x x {bad rows} contradicts 
the rainbow balancing property. If one could enumerate bad rows in space s 
then all bad rows would have complexity at most k and so y would be a good 
row. If T(x, y) G A y and y is known then x may be described by the table 
T, sets B x and A y and the ordinal number of x among all cells in the row y 
coloured in a colour from A y . Since y is good the last number requires less than 
C s (x) — d+ 1 bits. The sets B x and A y are described completely by n and G s (x) 
and may be enumerated in space O(s). Finally, if T has complexity 0(log n) and 
may be evaluated in space O(s) then we obtain a contradiction similar to the 
previous one. The whole argument may be repeated symmetrically for the com- 
plexity conditioned on x. As before, the crucial missing component is a simple 
and space-efficiently computable rainbow balanced table that also allows to enu- 
merate space-efficiently "bad" rows and columns. We now turn to a high-level 
description of our derandomization method. 

3.3 Derandomization plan 

To derandomize the construction we use a "naive" idea of replacing a random 
construction by a pseudo-random one. This idea was originally presented in [4] 



and |6]. The essence of the idea is to replace a brute- force search among all 
possible objects by a brute-force search in the output of the Nisan-Wigderson 
pseudo-random generator. Since the length of the seed is poly logarithmic in the 
size of the output the range of the search decreases crucially. To make the things 
work we should, firstly, prove that the necessary object exists among the output 
of the NW-generator and, secondly, prove that a good seed for the generator may 
be found efficiently. To prove the first thing we employ the basic principle [TJ that 
involves a constant-depth circuit to test the balancing property. The original 
balancing properties seem to be too hard to be tested by such circuits, so we 
weaken them. Specifically, for ordinary balanced tables we limit the balancing 
condition only to those rectangles and palettes being actually used in the proof. 
For rainbow balanced tables we go even further and directly specify the property 
used in the proof. Details follow in the next several subsections. In Sect. l3.4l we 
specify the weakening of the balancing property. In Sect. 13.51 we prove that 
a modified balanced table exists in the output of the NW-generator. Next, in 
Sect. 13.61 we show how to find a good seed in limited space. Finally, in Sect. 13.71 
we put all things together and finish the proof. We do all steps simultaneously 
for balanced tables (leading to Kolmogorov extractors) and rainbow balanced 
tables (leading to strong Kolmogorov extractors). 

3.4 The weakening of balancing conditions 

Recall that a table is a function T: {0, 1}" x {0, 1}" -» {0, 1}™. We refer to the 
first argument as to 'column', to the second one as to 'row' and to the value as to 
'colour'. Let b be a positive number and k < n and g<mbe some integers. Let 
there be a system S of pairs (S, I) where S is a subset of {0, 1}™ and I € [k, n] 
such that for any pair the set S contains less than 2 l elements and the whole 
system contains 2 poly (") pairs. Let there also be a system Q of subsets of {0, l} m 
(i.e., palettes) such that any Q <E Q contains less than 2 q elements and the whole 
system contains 2 poly( ") sets. Later we refer to sets in such systems as to relevant 
ones. Say that a table T is (b, <2, S)-balanced if for any (Si,h) and (5*2, h) G S 
and for any Q e Q the number of cells in Si x S2 coloured in a colour from Q 
is less than 2 ll+l2+q ~ m+b . If the sizes of Si and S2 are maximal, Q is the set 
of 2 q most popular colours and b = 1 then the bound matches the original one, 
i.e. the fraction of the popular colours is at most 2x|j. The new parameter b 
is introduced due to technical reasons and will be used in the next subsection. 
Take in mind that 6«1. 

The definition of rainbow balanced tables is modified in a more complicated 
way: we again fix a number b and a system S. Instead of a system Q of palettes 
we fix a system 1Z of tuples of palettes. Here each palette contains less than 
2 q elements, each tuple has length 2 l for some I € [k, 11} and the whole system 
contains 2 poly (") tuples. Take arbitrary sets Si and S2 € S with corresponding 
l\ and li and a tuple Q = (Qi, . . . , Q 2 i 2 ) G 'R- Then for each i £ [1, IS2I] mark 
those cells in i-th row of Si x S2 coloured in a colour from Qi. Say that a row is 
saturated if it contains more than 2 ll+q ~ m+b marked cells. We say that a table 
T is (b, 1Z, S)-row rainbow balanced if for any Si, S2 and Q the total number 



of marked cells in saturated rows is less than 2 ll+q ~ m+k+h . (In particular, there 
are less than 2 k saturated rows). We define a (b, 7Z, S)-column rainbow balanced 
table similarly and say that a table is (b, 1Z, <S)-rainbow balanced if it is both 
(6, 1Z, <S)-row and (b, 7Z, <S)-column rainbow balanced. 

One may easily see that for b > 1 our modifications actually do strictly 
weaken both balancing properties, so a random table satisfies a modified property 
with even greater probability than the original one. 

3.5 Existence of balanced tables in the output of the NW-generator 

To prove that a modified (rainbow) balanced table exists in the output of the 
NW-generator we employ the basic principle [TJ We present a constant-depth 
exponential circuit that tests the modified balancing property. By the basic 
principle, since the generator fools such circuits and a random table satisfies 
the modified balancing property with positive probability, the same holds for a 
pseudo-random one. A construction of such a circuit follows. 

The modified balancing properties are tested rather straightforwardly. Since 
we do not need to build a uniform circuit we just hardwire the lists of rele- 
vant sets into the circuit. That is, we construct a circuit for a particular tuple 
(S 1 ,S 2 ,h,h, Q) (or (Si,S 2 , h, h,Q)), make 2?°^") copies of this circuit for dif- 
ferent tuples and take a conjunction. The construction of such a circuit follows. 

It is rather easy to check whether a particular cell in S\ x S 2 is marked. Indeed, 
we should check whether its colour coincides with one of those belonging to Q 
(or Qi) and take the disjunction of all results. The difficult point is to count 
the number of marked cells and to compare this number to 2 ll+l2+q ~ m+h . (For 
rainbow balance we need to count marked cells in saturated rows and columns). 
This task cannot be solved exactly by constant-depth circuits but may be solved 
approximately. Fortunately, approximate solution is enough for our goal. 

We employ a circuit existing by theorem [3] Specifically, for ordinary bal- 
anced tables this curcuit has |Si| • IS2I inputs, outputs 1 if there are less than 
2h+h+q-m+i ones among the inputs, outputs if there are more than 2' 1+ ' 2+9 ~ m+101 
ones among the inputs and outputs any value otherwise. For rainbow balanced 
tables we use two such circuits sequentially. Firstly, we apply to every row a cir- 
cuit with I Si I inputs that outputs 1 if there are less than 2 ll+q ~ m+1 ones among 
its inputs, outputs zero if there are more than 2 ll+q ~ m+1 - 01 ones and outputs 
any value otherwise. Secondly, we count the number of ones in rows that produce 
one on the previous stage. To this end, we take conjunctions of the output of the 
previous circuit with the inpits and apply a circuit with |Si| • IS2I inputs that 
returns 1 if it receives less than 2 ll+q ~ m+k+1 ones, returns if it receives more 
than 2' 1+9 ~" l + fc+1 - 01 ones and returns any value otherwise. This construction is 
repeated for columns and a conjunction of two values is taken. 

The last subcircuit completes the description. Let us sketch the structure 
of the whole circuit once more. The input specifies colours of all 2 2 ™ cells of 
the table. We also add constants for all possible colours from {0, l} m . The full 
circuit consists of 2 poly ( n ) identical blocks. Each block has two groups of inputs. 
The left group specifies colours of all cells in a particular rectangle Si x S2. 



The right group specifies a palette Q (or a set of palettes Q). Different blocks 
are hardwired to different inputs and constants. For ordinary balanced tables 
each block consists of two levels. On the first level a simple equivalence circuit 
is applied to every pair of a colour from the left and a colour from the right. On 
the second level an approximate counting circuit is applied to the outputs of the 
first level. For rainbow balanced tables each block consists of five levels. The first 
level is the same. On the second level an approximate counting circuit is applied 
to the outputs of the first level separately for each row and for each column. On 
the third a conjunction of the outputs of the first two levels is taken separately 
for each row and for each column. On the fourth level another approximate 
counting circuit is applied to the outputs of the third level, separately for rows 
and columns. On the fifth level a conjunction of two results of the fourth level 
is taken. Finally, a conjunction is applied to outputs of all blocks. 

Clearly, these circuits have exponential size and constant depth. It is also clear 
that these circuits return one on (rainbow) balanced tables. Hence, they return 
one with positive probability on a random table. Hence, they return one with 
positive probability on a pseudo-random table produced by the NW-generator. 
If the first (resp., second) circuit returns one then the table is balanced (resp., 
rainbow balanced) for parameter b = 1.01. In the next two subsections we specify 
the systems S, Q and 1Z, show how to find a good seed for the generator and how 
to use a 1.01-balanced and 1.01-rainbow balanced tables to obtain the result. 

3.6 Searching for a good seed 

Until this point the construction was valid for any choice of the systems <S, Q 
and 1Z. The searching for a good seed cannot be performed for arbitrary systems, 
so now we specify them. 

We take S to be the system of all pairs ({z | C s (z) < I}, I) for s = s(n) 
and I € [k,n]. We take Q to be the system of all sets {z \ C s (z) < q] for 
s = s(n) and q € [l,wi]. Finally, we take 1Z to be the system of all tuples 
({z | C s (z\ Vl ) <q},...,{z | C s (*|u 2 <<?}) where ({vi, . . . ,v 2 i},l) £ S. Clearly, 
the sizes of all sets, tuples and systems satisfy the requirements. Since s(n) is 
space-constructible, the systems S and Q are enumerable in space O(s). It means 
that there exists an 0(s)-space algorithm that gets two numbers i and j and 
returns the i-th element of the j-th set in S (or Q). If one of the numbers is out 
of range the algorithm returns an error message. A similar statement holds for 
1Z, here the enumerating algorithm gets three numbers: the number of the tuple, 
the number of the set in the tuple and the number of the element in the set. 

Since we care only about space, the problem of searching a good seed is equiv- 
alent to the problem of checking whether a seed is good. The crucial property of 
NW-generator that makes such a check possible in small space is that any bit of 
the output may be computed in polynomial space independently from all other 
bits. That is, one need not store the whole exponential output to check some 
local property. A detailed description of such a check follows. 

After this point the constructions for ordinary and rainbow balanced tables 
are rather different. We start with the construction for ordinary tables. Firstly, let 



us notice that a seed is good if and only if it is good for any tuple (Si, S2, h,h, Q). 
So, it is sufficient to sequentially check that a seed is good for any such tuple. 
A tuple is determined by the ordinal numbers of (Si,li) and (S2,h) in the 
enumeration of S and that of Q in the enumeration of Q. Having these numbers 
fixed, we sequentially generate colours of all cells in Si x S2 and compare them 
to all colours in Q. Count the number of successive comparisons. Say that the 
tuple is good if this number is less than 2 ll+l2+q ~ m+lm . Since we are no more 
restricted to constant-depth circuits and may instead use any space-bounded 
computations the counting is made precisely. Since S and Q are enumerable in 
space O(s), the generator uses another O(s) portion of space, only space 0(n) is 
used for intermediate storage and s is at least polynomial in n, the total space 
requirement sums up to O(s). 

For rainbow balanced tables we sequentially check that a seed is good for any 
tuple (Si, S2, h, h)- The sets of palettes for row and column rainbow balanced 
properties are generated from Si and S2 respectively: for each Si — {xi, . . . , xl} 
and S 2 = {yi, ■ ■ ■ ,Vm} we take Qi = ({z | C s (z|yi) < q}, . . . ,{z | C s (z\y M ) < 
q}) and Q 2 = ({2 | C s (z|a;i) < q},...,{z | C s (z|a; L ) < q}). The subsequent 
check is performed by direct counting, as in the previous algorithm. The differ- 
ence is that the counting proceeds in two stages: for any row (or column) the 
number of marked cells is counted, then it is determined whether the row (col- 
umn) is saturated and the numbers for saturated rows (columns) are summed 
up. The used space is again O(s). 

3.7 Completion of the proof 

In this section we prove that the tables generated from seeds found by two algo- 
rithms in the previous subsection are indeed Kolmogorov and strong Kolmogorov 
extractors respectively. 

Firstly we check the Kolmogorov extractor property. Fix the extractor pa- 
rameters k = k(n), 5 — S(n) and s = s(n). Let d = S + clogn where c is a 
constant to be determined later and let q = m — d. Let p be the seed found for 
parameters k and q in Sect. 13.61 We want to prove that KExt p = NW(p) is a (k, 
(5)-Kolmogorov extractor for space bound s. Firstly, note that it is computable in 
space O(s): this space is enough both for finding p and computing KExt p (a;, y). 
Secondly, let us prove the Kolmogorov extractor property. Take two strings x 
and y such that C s (x) > k, C s (y) > k and C s (x, y) > C s (x) + C s (y) - 5 where fi 
does not depend on x or y and will be determined later. To obtain a contradiction 
assume that C s (KExt p (a;, y)) < m — d. Denote h = G s (x) and l 2 — C s (y) and 
consider the sets Si — {z \ G s (z) < h} and S 2 = {z \ C (z) < l 2 }. Each of them 
is relevant by construction. Denote Q = {z \ C s (z) < q}. This set is also rele- 
vant. By the choice of p the rectangle Si x S2 contains less than 2' 1+ ' 2 + 9 ~ m+1 - 01 
cells coloured in one of colours from Q. By the assumption and the definition 
of Si and S 2 , the pair (x, y) belongs to these cells. In this case (x,y) may be 
described by n, li, l 2 , q and the ordinal number of (x, y) among these cells. In- 
deed, having n known we may find a good seed p; having Zi, I2 and q known we 
may search through cells Si x S 2 and check whether the current one has a colour 



from Q. The ordinal number specifies the needed cell. The total required space 
is O(s). The total number of used bits is li + I2 — d + O(logn). So, we obtain 
C° (s) (x,y) < C s (x) + C s (y)-d+0(logn) = C s (x)+C s (y)-£-clogn+0(logn) 
that contradicts the condition C^ s > C s (x) + C s (y) — 8 for /1 and c taken large 
enough. 

Next, we check the strong Kolmogorov extractor property. We again fix the 
extractor parameters k, 8 and s. As before, let d = S + cAogn and q = m — d. Let 
p be again the seed found for parameters k and q (and the rainbow balancing 
property) in Sect. 13.61 We want to prove that KExt p = NW(p) is a strong (k, 
<5)-Kolmogorov extractor for space bound s. The computability in space O(s) is 
again easily obtained. Prove the strong Kolmogorov extractor property. Take two 
strings x and y such that C s (x) = h > k, C s (y) = h > k and C^ s (x,y) > h + 
I2 — 8 where fj, does not depend on x or y and will be determined later. To obtain 
a contradiction assume that C s (KExt p (x,y)|y) < m — d. Thus, the cell (x,y) is 
marked. Consider two cases: there are more than 2' 1_d + 101 strings z € S\ such 
that C s (KExt p (z, y)\y) < m — d and there are not more than 2 ll ~ d+101 such 
strings. In the first case the row y contains more than 2 /l+? ~ m+1 - 01 marked cells 
and thus is saturated. By the 1.01-rainbow balancing property the total number 
of marked cells in saturated rows is less than 2 h +i- m+k+lm < 2 / i+^-' J - cl °s™. 
Then (x, y) may be described in space O(s) by its ordinal number among marked 
cells in saturated rows and numbers n, h, h, <?■ Thus for large enough /x and c 
the complexity of (x, y) is less than l\ + I2 — 8 that contradicts the assumption. 
In the second case the pair (x, y) may be described by a description of y (fo 
bits), the ordinal number of (x,y) among marked cells (l\ — d+ 1.01 bits) and 
numbers n, h, h, q (O(logn) bits), totaling to l\ + I2 — d + O(logn) bits. The 
required space is O(s), so we obtain a similar contadiction to the assumption 
that C MS (x, y) > l\ + h — 8 for large enough /1 and c. This contradiction finishes 
the proof. 
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